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Introduction 

Forty years ago, Robert Gagne published the first edition of his book The Conditions of Learning 
(1965) in which he proposed nine events of instruction that provide a sequence for organizing a lesson. These 
events remain the foundation of current instructional design practice (Reiser, 2002; Richey, 2000). They 
represent desirable conditions in an instructional program and increase the probability of successful learner 
achievement in the program (Gagne, 1965, 1985, 1988; Gagne, Briggs & Wager, 1992). Other authors cite 
similar elements of instruction that promote student learning from an instructional program (Dick & Carey, 
1996; Sullivan & Higgins, 1983). 

Gagne (1985) defined instruction as “a set of deliberately planned external events designed to support 
the process of learning.” He noted that a designer or instructor controls these external events, and that learners 
control their own internal learning processes. His external events of instruction were conditions for facilitating 
effective learning processes in students. 

The individual events that Gagne incorporated into his model have been the subject of a substantial 
body of research. However, many of these events may produce a much different effect when they are studied 
individually than when they are combined into a more complete set that incorporates most or all of Gagne’s 
nine events. As Hannafin (1987) noted, some design strategies may have positive effects when used in isolation 
that are diminished or negated when these strategies are used in combination with more powerful techniques. 

A research design that incorporates most of Gagne’s events of instruction into a quite complete version 
of an instructional program, then systematically deletes selected events from other versions, has the potential to 
identify the events that are most powerful in promoting student learning. That type of design was used in the 
present research. The events from Gagne’s model that were directly incorporated into the study were objectives, 
information, examples, practice with feedback and review. The research literature on each of these events is 
briefly reviewed below. 

Objectives 

An instructional objective is a statement that describes an intended outcome of instruction (Mager, 
1962). According to Ausubel (1968) stating an objective at the beginning of instruction will help the individual 
learners to structure their own learning. Reiser and Dick (1996) state that, ‘‘At a fairly early stage, learners 
should be informed of what it is that they are going to be able to do when they finish the instructional process. 
By knowing what will be expected of them, learners may be better able to guide themselves through that 
process” (p.48). 

Some researchers have found that instructional objectives improve learning. Kaplan and Simmons 
(1974) reported that performance on information relevant to an objective was high when instructional objectives 
were used as orienting stimuli or as a summary/review upon prose learning. Staley (1978) found that the 
provision of objectives facilitated learning, but that presenting objectives by subsets had no advantage over 
presenting the entire set at once. Research on effectiveness of objectives in computer-based cooperative 
learning indicated that students who received instructional objectives performed significantly better on posttest 
items than students who received either advance organizers or no orienting activities (Klein & Cavalier, 1999). 
Studies have reported that objectives enhance learning of relevant content, but provide less assistance for 
incidental learning. (Kaplan & Simmons, 1974; Morse & Tillman, 1972; Rothkopf & Kaplan, 1972). Research 
has also indicated that inclusion of objectives resulted in more positive student attitudes (Staley, 1978). 

Some researchers have found that objectives do not produce a significant difference in learning (Filan 
& Gerlach, 1979; Hartley & Davis, 1976). Hannafin (1987) found that, when computer-based instruction was 
systematically designed, the presence of objectives did not make a difference but that it did influence 
performance in lessons that were not well designed. Research has also indicated that the benefits of objectives 
are reduced when a more powerful instructional element such as practice is included in computer-based lessons 
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(Hannafin, 1987; Hannafin, Philips, Rieber & Garhart, 1987; Philips, Hannafin & Tripp, 1988). 

Information 

A significant part of the instructional process involves presenting students with the necessary 
information for learning (Reiser & Dick, 1996). All models of direct instruction include presenting information 
to students. Gagne (1985) stresses the importance of emphasizing the information presented to the learners. In 
his nine events he mentions presenting the stimulus or content where information is presented to the learner. 
Distinctive features of what is to be learned should be emphasized or highlighted when the information is 
presented (Gagne, 1985). Content presented should be chunked and organized meaningfully. (Kruse & Kevin, 
1999). 

Practice and Feedback 

Practice is defined as the event of instruction provided to learners after they have been given 
information required to master an objective (Gagne, 1985). Practice involves eliciting performance from 
learners. It provides an opportunity for learners to confirm their correct understanding, and the repetition also 
increases the likelihood of retention (Kruse & Kevin, 1999). Practice is effective when it is aligned with the 
assessment in the form of a posttest and with the skills, knowledge and attitudes reflected in the objectives 
(Reiser & Dick, 1996). 

Researchers have found that practice has a significant effect on performance. Hannafin (1987) reported 
a significant difference between practiced and non-practiced items on the learning of cued and uncued 
information presented via computer-based instruction. Phillips et al. (1988) found a significant difference 
favoring practice over no practice in an interactive video in which practice items were embedded questions. 
Hannafin et al. (1987) noted that practice effects were more pronounced for facts than for application items in 
computer-based instruction. Participants who received intellectual skills practice in a cooperative learning 
environment performed significantly better than those who received verbal information practice (Klein & 
Pridemore, 1994). 

Practice provides an opportunity for feedback that confirms the student’s answer as being correct or 
indicates that is incorrect. This feedback strengthens the probability of correct responses and reduces the 
probability of subsequent incorrect responses (Philips et al., 1988). Simple forms of feedback are effective when 
learners are able to answer items correctly. More elaborate forms such as providing and explaining the correct 
answer and explaining why a wrong answer is incorrect are helpful when learners answer incorrectly (Kulhavy, 
1977). Simple forms of feedback are most effective for simple verbatim and verbal information types of 
learning (Kulhavy, White, Topp, Chan & Adams, 1985). 

Examples 

Examples are verbal or graphical information that provides additional clarification of rules or 
information presented to learners. Kruse and Kevin (1999) include examples, non-examples, graphical 
representation and analogies as guidance strategies that can be used to further clarify new content that is 
presented. 

Few studies have been conducted to examine effects of examples in a graphical representation form. 
Sullivan and Maher (1982) found a significant difference favoring the use of imagery over no imagery in prose 
learning by intermediate grade students. Walcyzk and Hall (1989) reported a significant difference for 
participants who received examples over those who did not in comprehension assessments. Freitag and 
Sullivan (1995) found that adults who received examples in a training program significantly outperformed those 
who did not. A considerable amount of research has been conducted recently on the effects of worked examples 
as an instructional aid (Atkinson, Catrambone & Merrill, 2003; Atkinson, Renkl & Merrill, 2003; Renkl, Stark 
& Gruber, 1998). 

Review 

The review process typically provides an outline of the key information that was presented to learners. 
It is intended to reinforce learning, at the end of the instruction, often just before students are tested. Reiser and 
Dick (1996) cite the value of reviews to bring closure to instruction and to help reinforce the skills and 
knowledge students should have acquired. 

Research has suggested that reviews benefit learning of incidental material because instructional 
stimuli are introduced after the content has been presented and initially processed (Kaplan & Simmons, 1974). 
The use of reviews to summarize salient information has been shown to enhance learning (Hartley & Davis, 
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1976). In studies on prose learning, reviews of relevant information yielded significantly better performance 
than when the information was presented without review (Bruning, 1968). 



Purpose of Current Study 

Many of the studies reported above were conducted to examine the effect of a single instructional 
event. In general, these studies found that the presence of the event under investigation resulted in a positive 
effect on student learning. It was also noted, however, that the effects of some of these events may be reduced 
considerably when they are combined with other events into a more complete and generally more appropriate 
program of instruction. 

The purpose of this study was to investigate effects of several of Gagne’s events of instruction when 
they were combined in a systematic manner with other events from the Gagne set. One event, information, was 
constant across all of the program versions in the study because information is a crucial element of instruction 
that cannot sensibly be deleted from it. The other events of instruction investigated in the study - objectives, 
practice with feedback, examples and reviews were combined into six different versions of an instructional 
program in a manner that permitted investigation of the effectiveness of the program when each event was 
present and when it was absent. 

The six different versions of the instructional program were as follows: 

1. Full program (Information + Objectives + Practice with Feedback + Examples + Review) 

2. Program without Objectives (Information + Practice with Feedback + Examples + Review) 

3. Program without Examples (Information + Objectives + Practice with Feedback + Review) 

4. Program without Practice (Information +Objectives + Examples + Review) 

5. Program without Review (Information + Objectives + Practice with Feedback + Examples) 

6. Lean program (Information Only) 

The primary research questions for this study are listed below. 

1. Which of Gagne’s events of instruction investigated in the study significantly affect student 
achievement? 

2. Which of Gagne’s events of instruction investigated in the study significantly affect student attitudes? 
The researchers anticipated that the four versions of program that included practice would have a positive 

effect on achievement partly because of the consistently favorable effects found for practice in other research 
and partly because of our own beliefs about its importance. Whether positive effects would be obtained for the 
other variables when they were combined with practice was unclear prior to the study. 

Method 



Participants 

Participants were 256 freshman and sophomore undergraduate students enrolled in a computer literacy 
course at a large Southwestern University. The students enrolled in this course had varied background 
knowledge on computers and were from different majors including education, communication, journalism and 
others. 

Materials 

Six different versions of a computer-based lesson on the topic Input, Processing, Storage and Output 
of a Computer (IPSO) were developed using Dreamweaver. IPSO explains the primary operations of the 
computer. An introduction section was included before the primary operations were explained in detail. This 
section introduced what a computer is and classified it based on size, power and generation. It also explained 
the IPSO cycle. The next four sections described the concepts of the Input, Processing, Storage and Output 
operations in a computer and explained the function of the different components associated with that operation. 
The content used in this study was part of the required content for the couise. The computer-based lesson was 
pilot tested with five students before it was used in the study. 

The material was designed in six different versions that included various combinations of Gagne’s 
instructional events as described above. The six versions consisted of (1) a full version that contained 
information plus all events investigated in the study, (2) a version without objectives (3) one without examples, 
(4) one without practice, (5) one without review and (6) a lean version containing information only. The 
systematic deletion of individual events permitted the study of the program both with and without each event. 
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Procedures 

Eighteen sections of students (n = 256) enrolled in the Computer Literacy Course were randomly 
assigned to the six treatment groups based on pretest scores. The pretest, which took approximately 15 minutes 
to complete, was administered three weeks prior to the study. The classes were blocked into three groups (high, 
medium and low) based on their mean pretest scores, and one class within each block was randomly assigned to 
each of the six treatments. 

The participants participated in the web-based IPSO lesson during the sixth week of the semester. 
Participants met in a regular computer lab for instruction and were directed by the instructor to the web address 
for the instructional program. Each class was routed directly to its treatment version of the program. Students 
worked through the program at their own pace, averaging approximately one hour. Then they took the posttest 
and the attitude survey online. All six treatment groups followed the same procedure. Thus, the experimental 
differences in treatments occurred exclusively in the materials themselves and not in the procedure. 

Criterion Measures 

The criterion measures consisted of a posttest and a student attitude survey. A pretest was used to 
assess subject’s knowledge of the content prior to the instruction and to randomly assign classes within ability 
blocks to treatment. 

Pretest - The pretest consisted of 20 multiple -choice questions covering the content with four response 
choice questions. The overall mean score on the pretest was 8.68 or 43%, indicating that participants were not 
very knowledgeable about the content prior to instruction. Thus participants had relatively little knowledge of 
content prior to instruction. There were no significant differences across the six treatment groups in pretest 
scores. 

Posttest - The posttest consisted of the same 20 multiple -choice questions that were on the pretest. It 
was judged to be unlikely that the pretest would have an effect on posttest scores that could be a threat to 
validity (Campbell & Stanley, 1963) because of the three-week interval between test and the fact that feedback 
was not given on the pretest. The posttest score was counted towards their course grade, and this motivated the 
learners to learn from the web-based lesson. 

Attitude Survey - The attitude survey assessed student attitudes towards the instructional program and 
the presence or absence of the instructional elements. The 12-item survey consisted of Likert -type questions that 
were rated strongly agree (scored as 4) to strongly disagree (scored as 0). The survey was administered after the 
lesson and the posttest were completed. 

Data Analysis 

A one-way ANOVA was conducted to analyze the posttest data for statistical significance. A 
MANOVA was conducted on the 12 attitude questions. Both analyses revealed significant differences. 
Therefore, Scheffe tests were performed for both data sets to test for significance between groups. Alpha was 
set at .01 for all statistical tests because of the large number of comparisons. 

Results 



Achievement 

Table 1 shows the mean scores and standard deviations by treatment for achievement on the posttest. 
The table shows that the mean scores for subjects in each of the four treatments (full program, program without 
objectives, program without examples, and program without review) were above 17 items correct, whereas the 
scores for the other two treatments (program without practice and lean program) were below 15 correct. The 
table also shows that the mean posttest score across all six treatments was 16.44 items correct. 

Table 1 Means and Standard Deviations for Posttest Scores by Treatment 



Treatment 


Posttest 


Posttest 




Mean 


SD 


Full Program 


17.61 


1.99 


Program without Objectives 


17.36 


1.75 
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Program without Examples 


17.16 


2.34 


Program without Review 


17.17 


2.76 


Program without Practice 


14.98 


2.66 


Lean Program 


14.73 


3.21 


Total 


16.44 


2.75 



A one-way ANOVA conducted on the posttest data yielded a significant difference between the 
treatment groups on the posttest, F (5, 250) = 11.689, p <.01. Follo\wup Scheffe tests revealed that each of the 
four groups with means scores above 17, as listed above and shown in the table, scored significantly higher than 
the two groups identified above that scored below 15. There were no significant differences between the four 
groups scoring above 17 or between the two scoring below 15. 

Attitude 

Table 2 shows means for responses to the 12 Likert -type items on the attitude survey. The items were 
rated on a 5- point Likert scale from strongly agree (scored as 4) to strongly disagree (scored as 0). 



Table 2 Attitude Scores by Treatment 



Attitude 


Questions 


*FP 


NO 


NE 


NR 


NP 


LP 


Total 


1 


The goals of the program were clear to 
me. 


**3.3 

4 


3.40 


3.22 


3.34 


3.17 


2.77 


3.21 


2 


I knew what I was supposed to learn at 
the start of each section of the program. 


3.07 


3.16 


3.11 


2.98 


2.96 


2.68 


2.99 


3 


The program included enough pictures 
and examples. 


3.20 


3.38 


2.41 


3.10 


3.06 


2.43 


2.93 


4 


The graphics helped me understand the 
content well. 


3.17 


3.32 


2.30 


3.12 


2.83 


2.36 


2.85 


5 


The review at the end of each section 
helped my learning. 


3.63 


3.74 


3.43 


3.39 


3.17 


2.68 


3.34 


6 


The program had enough opportunity to 
review the content. 


3.17 


3.18 


3.07 


2.76 


2.77 


2.48 


2.91 


7 


The practice in the program helped me 
learn the content. 


3.34 


3.52 


3.28 


3.05 


2.15 


2.39 


2.96 


8 


The program gave me enough 
opportunity to practice what I was 
learning. 


3.05 


3.20 


3.04 


2.56 


2.13 


2.25 


2.71 


9 


I learned a lot from this program. 


3.02 


3.22 


2.91 


2.88 


2.63 


2.64 


2.88 


10 


I would recommend this program to 
other students. 


3.07 


3.30 


2.72 


2.83 


2.52 


2.45 


2.82 


11 


I would enjoy using other computer 
programs like this one in future lessons. 


2.85 


3.26 


2.80 


2.56 


2.58 


2.36 


2.74 


12 


The overall quality of the program was 
good. 


3.20 


3.34 


3.11 


2.98 


2.88 


2.70 


3.04 




Average 


3.18 


3.34 


2.95 


2.96 


2.74 


2.52 


2.95 
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* Note. FP - Full Program NO- No Objectives Group 

NP - No Practice Group NE - No Examples Group 

NR - No Review Group LP - Lean Program 

** Note. 4= Strongly Agree 3= Agree 2= Neither agree nor disagree 1= Disagree 0 = Strongly Disagree 

A MANOVA conducted on the overall attitude data revealed a significant overall difference on the 12 
attitude questions, F (60, 1188.48) = 12.98, p <.01. Follow-up univariate analyses indicated significant 
differences on 1 1 of the 12 attitude survey items at the p<.01 level. The only item that did not show a significant 
difference at this level was “I knew what I was supposed to learn at the start of each section of the program.” 

The eleven items on which significance was obtained were further analyzed to identify significant 
differences between treatment groups on these items. Table 3 provides a summary of the significant differences 
found when follow-up Scheffe tests were conducted at the .01 level. These data show that participants who used 
the program without objectives had the most positive attitudes toward their treatment with 17 significant 
comparisons. Participants who used the lean program had the most negative attitudes toward their treatment 
with 21 significant negative comparisons. Those who used the program without practice had 10 significant 
negative comparisons. 

Table 3 Summary of Significantly Higher and Lower Differences for Student Attitudes 



Treatments 


*Significantly Higher 


**Significantly Lower 


Full Program 


10 




Program without Objectives 


17 




Program without Examples 


5 


7 


Program without Review 


5 




Program without Practice 


1 


10 


Lean Program 




21 



* Note. Indicates the number of between-group comparisons of mean scores across the 12 attitude items that 
were significantly more positive for each group. 

** Note. Indicates the number of between-group comparisons of mean scores across the 12 attitude items that 
were significantly more negative for each group 

On the attitude items regarding practice -- ‘‘The practice in the program helped me learn the content” 
(Item 7) and ‘‘The program gave me enough opportunity to practice what I was learning” (Item 8) -- participants 
in each of the two treatments that did not include practice had significantly lower attitudes than those in each of 
the four treatments that included practice. On the attitude items related to examples -- ‘‘The program included 
enough pictures and examples” (Item 3) and ‘‘The graphics helped me understand the content well” (Item 4) -- 
participants in the two treatments that did not include examples had the lowest attitudes compared to those in 
the treatments that provided examples. However, on the attitude items regarding objectives -- ‘‘The goals of the 
program were clear to me” (Item 1), and “I knew what I was supposed to learn at the start of each section of the 
program” (Item 2) — participants in the program without objectives gave the highest overall ratings of all six 
groups, though not significantly higher than most groups. 

The attitude survey also included two open-ended questions that asked the participants what they liked 
best and least about the program. The most frequent responses for what participants liked best were the review 
section (n= 63), the practice questions («= 59), examples/graphics («=37), and easy to use/usability («= 33). The 
most frequent responses for what was liked least were lots of information (/)= 54), length of the program 
(«= 39), and inability to go back to the previous screen (h= 10). Twenty-four participants mentioned that there 
was nothing they disliked about the program. 



Discussion 

This study examined the effects of instructional events (information, objectives, examples, practice and 
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review) on achievement and attitudes. College students enrolled in a computer literacy course used a computer- 
based lesson delivered on the web to learn about input, processing, storage and output of a computer (IPSO). 

Results indicated that among the instructional events, practice had the most impact on both learner 
achievement and attitudes. Participants who used one of the versions of the computer program that included 
practice (full program, program without objectives, program without examples and program without review) 
performed significantly better on the posttest than those who did not receive practice (program without practice 
and lean program). Furthermore, students who received practice in their program had consistently more positive 
attitudes than those who did not receive it. 

Achievement 

Practice was clearly the instructional event that had the strongest positive effect on achievement among 
the events manipulated in this study. Participants in all four treatments that included practice scored 
significantly higher on the posttest than those in the two conditions that did not include it. Whereas the removal 
of practice from the full program resulted in a significant decline in posttest performance, removal of any one of 
the three other events (objectives, examples, review) did not have such an effect. 

Practice of the type in this study is effective because it gives learners the opportunity to perform a 
similar or identical learning task to that assessed on the posttest. This practice combined with feedback, as it 
was in the present study, enables learners to confirm their correct understanding and to identify their incorrect 
ones. Thus, the probability of retention of correct responses is increased and the probability of incorrect 
responses is reduced when the practice is aligned with the subsequent posttest assessment (Philips et ah, 1988; 
Reiser & Dick, 1996). Practice also has the advantage of eliciting overt responses from the learner, a form of 
active participation not directly provided by the other elements of instruction investigated in this study. 

Whereas practice elicits overt responding from learners, the other elements investigated in the study 
either provide information that is additional to that contained in the information screens (that is, the objectives) 
or that is supplementary (examples) or primarily redundant (review) to the information. The absence of each of 
these elements individually in one of the three different treatments in the present study (program without 
objectives, without examples or without review) consistently yielded a posttest score between 17.16 and 17.36 
that varied only slightly and non -significantly from the score of 17.61 for students in the full program. Thus, 
there is no evidence from this study that any of these three elements individually contributed to increased 
student learning. Hannafin (1987) noted that when computer-based instruction is systematically designed, the 
presence of objectives for students may not increase their achievement. Nevertheless, the presence of objectives 
may be essential for the instructional designer to design the instruction systematically. 

Attitudes 

Turning to attitudes, results revealed that most participants had a favorable impression about the 
computer-based lesson used in this study. In general, they agreed with statements such as, “I learned a lot from 
this program,” “I would recommend this program to other students,” and ‘‘The overall quality of the program 
was good.” 

Results for attitudes were generally consistent with findings for achievement. When the items on the 
attitude survey were analyzed to examine differences between treatment groups, participants who used the lean 
program had the most negative attitudes toward their treatment followed by those who used the program 
without practice. Combined with results for achievement, this study suggests that practice not only increases 
learning, but the absence of it also diminishes students’ attitudes toward instruction. 

Student responses to the attitude survey showed that they were sensitive to the absence of some of the 
instructional elements investigated in this study. Participants who received practice in their program agreed 
significantly more with items related to the amount and helpfulness of the practice than students who did not 
receive practice. Furthermore, participants who received examples throughout the program agreed more with 
items related to the amount and usefulness of the examples than students who did not receive exa mples. These 
findings suggest that students are aware when practice and examples are left out of computer-based instruction 
and that excluding these elements has a detrimental effect on their attitudes. 

However, this pattern was not found for the attitude items related to objectives. Students in the no- 
objectives treatment had the most positive responses to the two items related to the goals and objectives of the 
program. They also had significantly more positive attitudes toward their treatment when their results were 
compared with students in several of the other treatments. This finding suggests that students may be unaware 
of the absence of objectives when other elements such as practice are included in the program. 

In addition, students may not always be aware of the absence of review in computer-based instruction. 
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Participants in the no-review treatment and those in the lean treatment did not receive review throughout their 
program. Nevertheless, students in the no -review condition had significantly rnoie positive response than those 
in the lean group on the item, “The review at the end of each section helped my learning.” It should be noted 
that when asked what they liked best about the program, students most frequently listed the element of review. 

Implications and Future Research 

This study has implications for the design and development of computer-based instruction. Practice 
was the one consistently effective instructional event for enhancing student achievement in the study. This 
suggests that it should be included in computer-based instruction especially when students are tested using 
items aligned with the objectives and practice items. However, the lack of effect produced by the one-at-a time 
removal of objectives, examples and review from individual treatment versions should not, of course, be 
interpreted as an indicator that one or more of these elements should routinely be deleted from an instructional 
program. If a program is well conceptualized, none of the three is very costly in terms of writing time by the 
designer, amount of text space in the lesson, or length of reading time by the learner. These three elements were 
included and removed systematically in the present study in order to investigate their effects in a controlled 
instructional environment. Their desirability, and possibly their effects, may vary in other settings depending on 
such factors as the age and motivation of the learners and the complexity of the subject matter. 

Future research should continue to focus on the impact of instructional events in various instructional 
settings. Additional research should examine how instructional events in computer-based instruction influence 
outcomes such as problem solving and complex learning tasks. Furthermore, the recent proliferation of web- 
based and Internet-based instruction suggests that studies should be conducted to examine the effect of 
objectives, examples, practice and review in these settings. As was done in this study, research in these settings 
should include measures of student achievement and attitudes. Studies of this nature will continue to inform 
designers about the influence of instructional events on learning and performance. 
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